Medical display control device, medical observation device, display control method, and medical observation system

ABSTRACT

Provided is a medical display control device including a display control unit that causes a first captured medical image and a second captured medical image to be simultaneously displayed, the first captured medical image having been captured in an imaging device in a first imaging mode where imaging is performed with special light, the second captured medical image having been captured in the imaging device in a second imaging mode different from the first imaging mode before the first captured medical image.

TECHNICAL FIELD

The present disclosure relates to a medical display control device, amedical observation device, a display control method, and a medicalobservation system.

BACKGROUND ART

In recent medical practice, a medical observation device enablingmagnified observation of an observation target, such as a lesion, may beused for support of a surgical operation. The medical observation devicemay be, for example, a medical observation device including an opticalmicroscope, or a medical observation device including an imaging devicethat functions as an electronic imaging microscope. Hereinafter, themedical observation device including the optical microscope will bereferred to as the “optical medical observation device”. Furthermore,hereinafter, the medical observation device including the imaging devicemay be referred to as the “electronic imaging medical observationdevice”, or simply as the “medical observation device”.

A technique related to optical medical observation devices has thus beendeveloped, the technique enabling two types of images of differentwavelength bands to be captured. A technique described in PatentLiterature 1 cited below, for example, is a technique related to asurgical microscope enabling acquisition of a visible light image of avisible wavelength band and a fluorescent image of a near infra-redwavelength band.

CITATION LIST Patent Literature

Patent Literature 1: Japanese Unexamined Patent Application, PublicationNo. 2010-213995

DISCLOSURE OF INVENTION Technical Problem

For example, a surgical microscope (corresponding to an optical medicalobservation device) described in

Patent Literature 1 includes a charge coupled device (CCD) that capturesan observation image of light of a visible wavelength band and a CCDthat captures an observation image of light of a visible wavelengthband, and thereby captures a visible light image of the visiblewavelength band and a fluorescent image of the near infra-red wavelengthband. Thus, when the technique described in Patent Literature 1 is used,a user who uses the surgical microscope is able to observe two types ofimages of different wavelength bands.

However, the surgical microscope that uses the technique described inPatent Literature 1, for examples, needs to include two CCDs, which arethe CCD that captures the observation image of the light of the visiblewavelength band and the CCD that captures the observation image of thelight of the visible wavelength band. Use of a configuration includingtwo CCDs like the surgical microscope that uses the technique describedin Patent Literature 1 may increase the cost of the device and makesdownsizing of the device difficult.

The present disclosure proposes a medical display control device, amedical observation device, a display control method, and a medicalobservation system, which are novel and improved, and enable capturedmedical images to be simultaneously displayed on a display screen, thecaptured medical images having been captured by an imaging device indifferent imaging modes.

Solution to Problem

According to the present disclosure, there is provided a medical displaycontrol device including: a display control unit configured to cause afirst captured medical image and a second captured medical image to besimultaneously displayed, the first captured medical image having beencaptured in an imaging device in a first imaging mode where imaging isperformed with special light, the second captured medical image havingbeen captured in the imaging device in a second imaging mode differentfrom the first imaging mode before the first captured medical image.

Moreover, according to the present disclosure, there is provided amedical observation device including: an arm formed of plural linksconnected to one another via joints; an imaging device supported by thearm; and a display control unit is configured to cause a first capturedmedical image and a second captured medical image to be simultaneouslydisplayed, the first captured medical image having been captured in theimaging device in a first imaging mode where imaging is performed withspecial light, the second captured medical image having been captured inthe imaging device in a second imaging mode different from the firstimaging mode before the first captured medical image.

Moreover, according to the present disclosure, there is provided adisplay control method executed by a medical display control device, thedisplay control method including: a step of simultaneously displaying afirst captured medical image captured in an imaging device in a firstimaging mode where imaging is performed with special light, and a secondcaptured medical image captured in the imaging device in a secondimaging mode different from the first imaging mode before the firstcaptured medical image.

Moreover, according to the present disclosure, there is provided amedical observation system including: a medical observation deviceincluding: an arm formed of plural links connected to one another viajoints; and an imaging device supported by the arm; a display device;and a medical display control device including a display control unit isconfigured to cause a first captured medical image and a second capturedmedical image to be simultaneously displayed on a display screen of thedisplay device, the first captured medical image having been captured inthe imaging device in a first imaging mode where imaging is performedwith special light, the second captured medical image having beencaptured in the imaging device in a second imaging mode different fromthe first imaging mode before the first captured medical image.

Advantageous Effects of Invention

According to the present disclosure, captured medical images that havebeen captured by an imaging device in different imaging modes are ableto be simultaneously displayed on a display screen.

This effect is not necessarily limiting, and additionally to thiseffect, or instead of this effect, any effect described in thisspecification, or any other effect perceivable from this specificationmay be achieved.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an explanatory diagram illustrating a first example of aconfiguration of a medical observation system according to anembodiment.

FIG. 2 is an explanatory diagram illustrating an example of a use casewhere the medical observation system according to the embodiment isused.

FIG. 3 is an explanatory diagram for explanation of an example of aconfiguration of an imaging device included in a medical observationdevice according to the embodiment.

FIG. 4 is an explanatory diagram illustrating an example of an imagingmode selecting switch forming the imaging device included in the medicalobservation device according to the embodiment.

FIG. 5 is block diagram illustrating an example of a configuration ofthe medical observation system according to the embodiment, to which adisplay control method according to the embodiment is applied.

FIG. 6 is an explanatory diagram for explanation of an example ofoperation of the medical observation system according to the embodiment,the operation being realized by processing related to the displaycontrol method according to the embodiment.

FIG. 7 is a diagram illustrating an example of a captured medical imagedisplayed on a display screen of a display device, through the operationof the medical observation system illustrated in FIG. 6.

FIG. 8 is a diagram illustrating an example of a captured medical imagedisplayed on the display screen of the display device, through theoperation of the medical observation system illustrated in FIG. 6.

FIG. 9 is a diagram illustrating an example of captured medical imagesdisplayed on the display screen of the display device, through theoperation of the medical observation system illustrated in FIG. 6.

FIG. 10 is a diagram illustrating an example of captured medical imagesdisplayed on the display screen of the display device, through theoperation of the medical observation system illustrated in FIG. 6.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, a preferred embodiment of the present disclosure will bedescribed in detail, while reference is made to the appended drawings.Redundant explanation of any components having substantially the samefunctional configuration will be omitted by assignment of the samereference sign to these components, throughout the specification anddrawings.

Furthermore, the description will be made below in the following order.

1. Medical Observation System According to Embodiment

2. Display Control Method According to Embodiment

3. Program According to Embodiment

Medical Observation System According to Embodiment

Described first of all is an example of a medical observation systemaccording to an embodiment.

An example where a medical observation device according to theembodiment is an electronic imaging medical observation device will bedescribed mainly below, but the medical observation device according tothe embodiment is not necessarily the electronic imaging medicalobservation device. For example, the medical observation deviceaccording to the embodiment may be “any medical observation device thathas plural imaging modes including an imaging mode where imaging isperformed with special light (described later) and is able to performimaging by switching between the imaging modes”, such as an endoscopedevice.

[1] Configuration of Medical Observation System

FIG. 1 is an explanatory diagram illustrating an example of aconfiguration of a medical observation system 1000 according to theembodiment. The medical observation system 1000 has, for example, amedical observation device 100, a control device 200, a display device300, and a storage device 400.

The medical observation system according to the embodiment is notlimited to the example illustrated in FIG. 1.

For example, in the medical observation system according to theembodiment, the medical observation device 100 may have functions of thecontrol device 200. If the medical observation device 100 has thefunctions of the control device 200, the medical observation systemaccording to the embodiment may be, for example, without the controldevice 200.

Furthermore, in this medical observation system according to theembodiment, for example, the medical observation device 100 or thecontrol device 200 may have functions of the storage device 400. If themedical observation device 100 or the control device 200 has thefunctions of the storage device 400, the medical observation systemaccording to the embodiment may be, for example, without the storagedevice 400.

Furthermore, the medical observation system according to the embodimentmay be configured to have one or more of: plural medical observationdevices 100; plural control devices 200; and plural display devices 300.

If the medical observation system according to the embodiment has pluralmedical observation devices 100 and plural control devices 200, themedical observation devices 100 and the control devices 200 may beassociated with each other one to one, or plural ones of the medicalobservation devices 100 may be associated with one of the controldevices 200. If plural ones of the medical observation devices 100 areassociated with one of the control devices 200, at the control device200, which one of these medical observation devices 100 is to becontrolled by that control device 200 is changed by, for example, aswitching manipulation being performed.

Furthermore, if the medical observation system according to theembodiment has plural medical observation devices 100 and plural displaydevices 300, the medical observation devices 100 and the display devices300 may be associated with each other one to one, or plural ones of themedical observation devices 100 may be associated with one of thedisplay devices 300. If plural ones of the medical observation devices100 are associated with one of the display devices 300, a captured imagecaptured in which one of these medical observation devices 100 is to bedisplayed by the display device 300 on a display screen thereof ischanged by, for example, a switching manipulation being performed.

Furthermore, as described above, instead of the medical observationdevice 100 illustrated in FIG. 1, the medical observation systemaccording to the embodiment may have “any medical observation devicethat has plural imaging modes including an imaging mode where imaging isperformed with special light (described later) and is able to performimaging by switching between the imaging modes”.

FIG. 2 is an explanatory diagram illustrating an example of a use casewhere the medical observation system 1000 according to the embodiment isused.

An image of a patient PA to be observed (a patient who is a targetreceiving medical intervention) is captured by an imaging device(described later) included in the medical observation device 100.Hereinafter, a captured image captured by the medical observation deviceaccording to the embodiment, such as a captured image having the patientcaptured therein, is referred to as a “captured medical image”, thepatient being the target receiving the medical intervention.

A captured medical image captured in the medical observation device 100is displayed on the display screen of the display device 300. A surgicaloperator (OP) who administers medical intervention (an example of a userof the medical observation device 100) by using the medical observationdevice 100 administers medical intervention to the patient PA whilelooking at the captured medical image being displayed on the displayscreen of the display device 300.

Furthermore, the surgical operator OP causes an arm (described later),the imaging device (described later), or the like, which is included inthe medical observation device 100, to operate, and the medicalobservation device 100 to be brought into a desired state, bymanipulating a manipulation device, such as a foot switch FS, which isexternal to the medical observation device 100, or a manipulation device(described later) included in the medical observation device 100.

Each device forming the medical observation system 1000 will bedescribed below.

[1-1] Display Device 300

The display device 300 is a display means in the medical observationsystem 1000, and corresponds to a display device external to the medicalobservation device 100. The display device 300 displays, for example,various images, such as a captured medical image (a moving image, orplural still images, the same applying hereinafter) captured in themedical observation device 100, and an image related to a user interface(UI), on the display screen. Furthermore, the display device 300 may beconfigured to enable 3D display. The display in the display device 300is controlled by, for example, the control device 200.

In the medical observation system 1000, the display device 300 isinstalled at any place, such as, for example, a wall surface, a ceiling,or a floor surface, of a surgical operating room, the place beingvisually recognizable by a person, such as a surgical operator, who isinvolved in a surgical operation in the surgical operating room. Thedisplay device 300 may be, for example, a liquid crystal display, anorganic electro-luminescence (EL) display, or a cathode ray tube (CRT)display.

The display device 300 is not limited to the above described example.

For example, the display device 300 may be any wearable device, such asa head-mounted display or an eye-wearable device, which is used by beingworn by a surgical operator or the like on his/her body.

The display device 300 is driven by, for example, electric powersupplied from an internal power source, such as a battery, which isincluded in the display device 300, or electric power supplied from anexternal power source connected to the display device 300.

[1-2] Storage Device 400

The storage device 400 is a storage means in the medical observationsystem 1000, and corresponds to a recording medium external to themedical observation device 100. The storage device 400 includes, forexample, any recording medium, such as: a magnetic recording medium,like a hard disk; or a non-volatile memory, like a flash memory, therecording medium being able to store therein data.

The storage device 400 stores therein, for example, various data, suchas data representing images, such as a first captured medical image anda second captured medical image, which will be described later, and datarelated to a patient.

The storage device 400 is connected to an external device, such as thecontrol device 200, through wired communication of any communicationscheme or wireless communication of any communication scheme, and thedata stored in the storage device 400 are read by the external device asappropriate. FIG. 1 illustrates an example where the storage device 400is connected to the control device 200, but the storage device 400 maybe connected to the medical observation device 100 or the display device300.

The storage device 400 is driven by, for example, electric powersupplied from an internal power source, such as a battery, which isincluded in the storage device 400, or electric power supplied from anexternal power source connected to the storage device 400.

[1-3] Control Device 200

The control device 200 controls each of operation in the medicalobservation device 100 and operation in the display device 300.Furthermore, the control device 200 controls, for example, writing ofdata into the storage device 400, and reading of data from the storagedevice 400. That is, the control device 200 plays a role of controllingthe operation of the various devices forming the medical observationsystem 1000.

Furthermore, the control device 200 plays a role of, for example,performing processing related to a later described display controlmethod according to the embodiment. The control device 200 that playsthe role of performing the processing related to the later describeddisplay control method according to the embodiment functions as amedical display control device in the medical observation system 1000.

By the control device 200 performing the processing related to the laterdescribed display control method according to the embodiment, an imageaccording to a result of the processing related to the display controlmethod is displayed on the display screen of the display device 300. Anexample of the image displayed on the display screen of the displaydevice 300 by the processing related to the display control methodaccording to the embodiment will be described later.

The control device 200 includes, for example: one or more processors(not illustrated in the drawings) each formed of an arithmetic operationcircuit, such as a micro processing unit (MPU); a read only memory (ROM,not illustrated in the drawings); a random access memory (RAM, notillustrated in the drawings); a recording medium (not illustrated in thedrawings); and a communication device (not illustrated in the drawings).The control device 200 is driven by, for example, electric powersupplied from an internal power source, such as a battery, which isincluded in the control device 200, or electric power supplied from anexternal power source connected to the control device 200.

The processor (not illustrated in the drawings) performs processingrelated to control of a control target, such as the medical observationdevice 100. Furthermore, the processor (not illustrated in the drawings)functions as, for example, a display control unit (described later), andproactively performs the processing related to the later describeddisplay control method according to the embodiment. The processingrelated to the display control method according to the embodiment may beperformed by a processing circuit that is separately bodied from theprocessor (not illustrated in the drawings).

The ROM (not illustrated in the drawings) stores therein a program usedby the processor (not illustrated in the drawings), and control data,such as arithmetic operation parameters. The RAM (not illustrated in thedrawings) temporarily stores therein the program or the like executed bythe processor (not illustrated in the drawings).

The recording medium (not illustrated in the drawings) is a storagemeans included in the control device 200, and stores therein, forexample, various data, such as data related to control and variousapplications.

Furthermore, the recording medium (not illustrated in the drawings) mayhave, stored therein, image data representing a captured medical imagecaptured by the imaging device (described later) included in the medicalobservation device 100 (one or both of image data representing the firstcaptured medical image described later and image data representing thesecond captured medical image described later). If the image data arestored in the recording medium (not illustrated in the drawings), forexample, the control device 200 functions as the storage device 400.

The recording medium (not illustrated in the drawings) may be, forexample, a magnetic recording medium, such as a hard disk, or anon-volatile memory, such as a flash memory. Furthermore, the recordingmedium (not illustrated in the drawings) may be attachable to anddetachable from the control device 200.

The communication device (not illustrated in the drawings) is acommunication means included in the control device 200, and plays a roleof performing communication wirelessly or wiredly with an externaldevice, such as the medical observation device 100, the display device300, or the storage device 400. The communication device (notillustrated in the drawings) may be, for example: an IEEE 802.15.1 portand a transmitting and receiving circuit (wireless communication); anIEEE 802.11 port and a transmitting and receiving circuit (wirelesscommunication); a communication antenna and a radio frequency (RF)circuit (wireless communication); or a local area network (LAN) terminaland a transmitting and receiving circuit (wired communication).

The control device 200 may be, for example, any device, such as “amedical controller” or “a computer, such as a server”, which is able tocontrol the operation of the various devices forming the medicalobservation system according to the embodiment. Furthermore, if thecontrol device 200 functions as the storage device 400, the controldevice 200 may be, for example, any device, such as a “recorder”, whichis able to store therein data. Moreover, the control device 200 may be,for example, an integrated circuit (IC) that is able to be incorporatedinto the above device.

In one example of control in the control device 200, the control device200 causes, based on, for example, manipulation of the medicalobservation device 100, the medical observation device 100 to operate inan operation mode (described later) corresponding to the manipulation.

Furthermore, the control device 200 controls, based on, for example,manipulation of the medical observation device 100, imaging in theimaging device (described later) included in the medical observationdevice 100. The control of the imaging according to the embodiment maybe, for example, one or both of control of the zoom magnification andcontrol of the focal distance.

Furthermore, if an image signal transmitted from the medical observationdevice 100 is received, the image signal having been generated byimaging in the imaging device (described later) included in the medicalobservation device 100, image processing on the image signal isperformed by, for example, the processor (not illustrated in thedrawings) in the control device 200. The image processing according tothe embodiment may be, for example, one or more of various types ofprocessing, such as gamma correction, white balance adjustment, imageenlargement or reduction related to the electronic zoom function, orcorrection among pixels. In the medical observation system according tothe embodiment, the image processing according to the embodiment may beperformed in the medical observation device 100.

The control device 200 transmits, for example, a display control signalincluding a display command, and an image signal subjected to the aboveimage processing, to the display device 300. By the transmission of thedisplay control signal and image signal to the display device 300, acaptured medical image having an observation target captured therein(for example, a captured medical image having a site of surgicaloperation captured therein) is displayed on the display screen of thedisplay device 300, the displayed captured medical image having beenenlarged or reduced to a desired magnification by one or both of theoptical zoom function and electronic zoom function.

The captured medical image to be displayed on the display screen of thedisplay device 300 by the control device 200 is not limited to the abovedescribed example. Examples of the captured medical image to bedisplayed on the display screen of the display device 300 by the controldevice 200 will be described later.

[1-4] Medical Observation Device 100

The medical observation device 100 is an electronic imaging medicalobservation device. For example, if the medical observation device 100is used in a surgical operation, a surgical operator (an example of auser of the medical observation device 100) observes a site of surgicaloperation while referring to a captured medical image captured by themedical observation device 100 and displayed on the display screen ofthe display device 300, and performs various treatments, such asmaneuvers according to operative surgical procedures, on the site ofsurgical operation.

The medical observation device 100 includes, for example, a base 102, anarm 104, and an imaging device 106.

Furthermore, the medical observation device 100 may include, forexample, a communication device (not illustrated in the drawings) thatperforms communication according to a communication scheme correspondingto the communication device (not illustrated in the drawings) includedin the control device 200, although this is not illustrated in FIG. 1.For example, if the imaging device 106 and the control device 200 areconnected to each other wiredly, the medical observation device 100 isable to be configured to not separately include the communication device(not illustrated in the drawings). The medical observation device 100 isdriven by, for example, electric power supplied from an internal powersource, such as a battery, which is included in the medical observationdevice 100, or electric power supplied from an external power sourceconnected to the medical observation device 100.

[1-4-1] Base 102

The base 102 is a base of the medical observation device 100, has oneend of the arm 104 connected thereto, and supports the arm 104 and theimaging device 106.

Furthermore, the base 102 has, for example, wheels provided therein, andthe medical observation device 100 contacts a floor surface via thewheels. By the provision of the wheels, the medical observation device100 is able to easily move on the floor surface by means of the wheels.

[1-4-2] Arm 104

The arm 104 is formed of plural links connected to one another viajoints.

Furthermore, the arm 104 supports the imaging device 106. The imagingdevice 106 supported by the arm 104 is three-dimensionally movable, andthe position and posture of the imaging device 106 that has been movedare retained by the arm 104.

More specifically, the arm 104 is formed of, for example: plural joints110 a, 110 b, 110 c, 110 d, 110 e, and 110 f, and plural links 112 a,112 b, 112 c, 112 d, 112 e and 112 f that are rotatably connected to oneanother via the joints 110 a, 110 b, 110 c, 110 d, 110 e, and 110 f. Arotatable range of each of the joints 110 a, 110 b, 110 c, 110 d, 110 e,and 110 f is arbitrarily set in the design phase and manufacturingphase, such that desired movement of the arm 104 is realized.

That is, in the medical observation device 100 illustrated in FIG. 1,six degrees of freedom are realized with respect to movement of theimaging device 106, by means of six rotation axes (a first axis O1, asecond axis O2, a third axis O3, a fourth axis O4, a fifth axis O5, anda sixth axis O6) corresponding to the six joints 110 a, 110 b, 110 c,110 d, 110 e, and 110 f that form the arm 104. More specifically, in themedical observation device 100 illustrated in FIG. 1, movement of sixdegrees of freedom, which are three degrees of translational freedom andthree degrees of rotational freedom, is realized.

The joint 110 a has a substantially columnar shape, and supports theimaging device 106 (an upper end portion of the imaging device 106 inFIG. 1) rotatably about the rotation axis (the first axis O1) parallelto a center axis of the imaging device 106, by means of a distal endportion (a lower end portion in FIG. 1) of the joint 110 a. The medicalobservation device 100 is formed such that the first axis O1 coincideswith the optical axis in the imaging device 106. That is, the field ofview of a captured medical image captured by the imaging device 106 ischanged as if being rotated, by rotation of the imaging device 106 aboutthe first axis O1 illustrated in FIG. 1.

The link 112 a is a member that is substantially rod shaped, andsupports the joint 110 a fixedly. The link 112 a is, for example,extended in a direction orthogonal to the first axis O1, and connectedto the joint 110 b.

The joint 110 b has a substantially columnar shape, and supports thelink 112 a rotatably about the rotation axis (the second axis O2)orthogonal to the first axis O1. Furthermore, the link 112 b isconnected fixedly to the joint 110 b.

The link 112 b is a member that is substantially rod shaped, and isextended in a direction orthogonal to the second axis O2. Furthermore,each of the joint 110 b and joint 110 c is connected to the link 112 b.

The joint 110 c has a substantially columnar shape, and supports thelink 112 b rotatably about the rotation axis (the third axis O3)orthogonal to each of the first axis O1 and second axis O2. Furthermore,one end of the link 112 c is fixedly connected to the joint 110 c.

By rotation of a distal end (an end where the imaging device 106 isprovided) of the arm 104 about the second axis O2 and third axis O3, theimaging device 106 is able to be moved such that position of the imagingdevice 106 is changed in a horizontal plane. That is, in the medicalobservation device 100, control of rotation about the second axis O2 andthird axis O3 enables movement of the field of view of a capturedmedical image in a plane.

The link 112 c is a member, which has one end having a substantiallycolumnar shape, and another end that is substantially rod shaped.Connection to the one end of the link 112 c is performed fixedly, suchthat the center axis of the joint 110 c coincides with the center axisof the substantially columnar shape. Furthermore, the joint 110 d isconnected to the other end of the link 112 c.

The joint 110 d has a substantially columnar shape, and supports thelink 112 c rotatably about the rotation axis (the fourth axis O4)orthogonal to the third axis O3. The link 112 d is connected fixedly tothe joint 110 d.

The link 112 d is a member that is substantially rod shaped, and isextended orthogonally to the fourth axis 04. One end of the link 112 dis fixedly connected to the joint 110 d, so as to abut a side surface ofthe substantially columnar shape of the joint 110 d. Furthermore, thejoint 110 e is connected to the other end of the link 112 d (an endopposite to the end connected to the joint 110 d).

The joint 110 e has a substantially columnar shape, and supports one endof the link 112 d rotatably about the rotation axis (the fifth axis O5)parallel to the fourth axis O4. Furthermore, one end of the link 112 eis fixedly connected to the joint 110 e.

The fourth axis O4 and the fifth axis O5 are rotation axes that allowthe imaging device 106 to be moved in a vertical direction. By rotationof the distal end (the end where the imaging device 106 is provided) ofthe arm 104 about the fourth axis O4 and fifth axis O5, the position ofthe imaging device 106 in the vertical direction is changed. Thus, byrotation of the distal end (the end where the imaging device 106 isprovided) of the arm 104 about the fourth axis O4 and fifth axis O5, thedistance between the imaging device 106 and an observation target, suchas a site of surgical operation in a patient, is able to be changed.

The link 112 e is a member formed of a combination of: a first membersubstantially having an L-shape with one side thereof extending in avertical direction and another side thereof extending in a horizontaldirection; and a second member, which extends vertically downward from aportion of the first member, the portion extending in the horizontaldirection, and which is rod-shaped. The joint 110 e is fixedly connectedto a portion of the first member of the link 112 e, the portionextending in the vertical direction. Furthermore, the joint 110 f isconnected to the second member of the link 112 e.

The joint 110 f has a substantially columnar shape, and supports thelink 112 e rotatably about the rotation axis (the sixth axis O6)parallel to the vertical direction. Furthermore, the link 112 f isconnected fixedly to the joint 110 f.

The link 112 f is a member that is substantially rod shaped, and isextended in the vertical direction. The joint 110 f is connected to oneend of the link 112 f. Furthermore, the other end (an end opposite tothe end connected to the joint 110 f) of the link 112 f is fixedlyconnected to the base 102.

By the arm 104 having the above described configuration, in the medicalobservation device 100, six degrees of freedom are realized with respectto movement of the imaging device 106.

The configuration of the arm 104 is not limited to the example describedabove.

For example, the joints 110 a, 110 b, 110 c, 110 d, 110 e, and 110 f ofthe arm 104 may respectively be provided with brakes that restrictrotation at the joints 110 a, 110 b, 110 c, 110 d, 110 e, and 110 frespectively. Examples of the brakes according to the embodiment includebrakes of any form, such as brakes that are mechanically driven, andelectromagnetic brakes that are electrically driven.

Driving of the brakes is controlled by, for example, the control device200. By the control of the driving of the brakes, in the medicalobservation device 100, an operation mode of the arm 104 is set.Examples of the operation mode of the arm 104 include a fixed mode and afree mode.

The fixed mode according to the embodiment is an operation mode where,for example, the position and posture of the imaging device 106 arefixed by restriction of rotation about the rotation axes provided in thearm 104 by means of the brakes.

Furthermore, the free mode according to the embodiment is an operationmode where the rotation axes provided in the arm 104 are freelyrotatable by the brakes being released. For example, in the free mode,the position and posture of the imaging device 106 are allowed to beadjusted through direct manipulation by a surgical operator. The directmanipulation according to the embodiment means, for example,manipulation where a surgical operator holds the imaging device 106 inhis/her hand and directly moves the imaging device 106.

[1-4-3] Imaging Device 106

The imaging device 106 is supported by the arm 104, and captures animage of an observation target, such as, for example, a site of surgicaloperation in a patient. Imaging in the imaging device 106 is controlledby, for example, the control device 200.

The imaging device 106 has a configuration corresponding to, forexample, an electronic imaging microscope.

FIG. 3 is an explanatory diagram for explanation of an example of theconfiguration of the imaging device 106 included in the medicalobservation device 100 according to the embodiment.

The imaging device 106 has, for example, an imaging member 120, and acylindrical member 122 having a substantially cylindrical shape, and theimaging member 120 is provided in the cylindrical member 122.

On a plane of an opening at a lower end of the cylindrical member 122 (alower end in FIG. 3), for example, a cover glass (not illustrated in thedrawings) for protecting the imaging member 120 is provided.

Furthermore, for example, a light source (not illustrated in thedrawings) is provided inside the cylindrical member 122, and uponimaging, illumination light is emitted from the light source to asubject through the cover glass. Reflected light (observation light)from the subject irradiated with the illumination light enters theimaging member 120 via the cover glass (not illustrated in thedrawings), and an image signal representing the subject (an image signalrepresenting a captured medical image) is thereby acquired by theimaging member 120.

Furthermore, a filter that transmits therethrough light of a specificwavelength band and does not transmit therethrough light of otherwavelength bands, and a moving mechanism that selectively places thefilter onto an optical path are provided inside the cylindrical member122. The moving mechanism operates in conjunction with, for example, animaging mode selecting switch (described later), and selectively placesthe filter onto the optical path correspondingly to a state of theimaging mode selecting switch. The moving mechanism selectively placesthe filter onto the optical path by moving the filter, based on, forexample, a switching signal transmitted according to manipulation of theimaging mode selecting switch (described later).

Examples of the specific wavelength band transmitted through the filteraccording to the embodiment include: a near infra-red wavelength band(for example, a wavelength band from about 0.7 micrometers to about 2.5micrometers); a fluorescent wavelength band according to fluorescentobservation by use of 5-aminolevulinic acid (5-ALA) (for example, awavelength band from about 0.6 micrometers to about 0.65 micrometers);and a fluorescent wavelength band of indocyanine green (ICG) (forexample, a wavelength band from about 0.82 micrometers to about 0.85micrometers).

In the medical observation device 100, a filter according to a use wherethe medical observation device 100 is used is provided in the imagingdevice 106.

In the medical observation device 100, plural filters where wavelengthbands transmitted therethrough are different from one another may beprovided in the imaging device 106. If the plural filters are providedin the imaging device 106, the moving mechanism selectively places oneof the plural filters onto the optical path, the one corresponding to astate of the imaging mode selecting switch.

By the filter being placed onto the optical path, the imaging device 106is allowed to perform imaging with light of a specific wavelength bandcorresponding to the filter.

The above description is on an example where imaging is performed withlight of a specific wavelength band by placement of a filter on theoptical path, but needless to say, the configuration of medicalobservation device 100 for performing imaging with light of a specificwavelength band is not limited to the above described example.

Hereinafter, light of a specific wavelength band will be referred to as“special light”. Furthermore, hereinafter, light with its wavelengthband not limited by a filter or the like will be referred to as “naturallight”, distinctively from special light.

Any configuration used in various known electronic imaging microscopesis able to be adopted for the imaging member 120.

For example, the imaging member 120 is configured to include, forexample: an optical system 120 a; and an image sensor 120 b including animaging element that captures an image of an observation target by meansof light that has passed through the optical system 120 a. The opticalsystem 120 a is formed of, for example: one or more of lenses, such asan objective lens, a zoom lens, and a focus lens; and an opticalelement, such as a mirror. The image sensor 120 b may be, for example,an image sensor having plural imaging elements used therein, the imagingelements being, for example, complementary metal oxide semiconductors(CMOSs) or CCDs.

The imaging member 120 may be configured to have a pair of imagingelements, that is, configured to function as a so-called stereo camera.The imaging member 120 is installed with one or more functions generallyincluded in an electric imaging microscope, such as auto focus functionsincluding at least a zoom function (one or both of an optical zoomfunction and an electronic zoom function).

Furthermore, the imaging member 120 may be configured to enable imagingof so-called high definition, for example, 4K or 8K. By the imagingmember 120 being configured to enable high definition imaging, displayof an image by the display device 300 having a large display screen of,for example, 50 inches or more, is enabled with predetermined definition(for example, full HD image quality) ensured, and thus visualrecognizability by a surgical operator looking at the display screen isimproved. Moreover, by the imaging member 120 being configured to enablehigh definition imaging, predetermined definition is able to be ensuredeven if a captured medical image is displayed enlarged by the electroniczoom function on the display screen of the display device 300. Inaddition, when predetermined definition is ensured by use of theelectronic zoom function, performance of the optical zoom function inthe imaging device 106 is able to be reduced, and thus the opticalsystem of the imaging device 106 is able to be simplified more, and theimaging device 106 is able to be downsized more.

Furthermore, as described above, the imaging member 120 may be providedwith, for example, the above described filter, and a moving mechanismthat selectively places the filter onto the optical path.

The imaging device 106 is provided with, for example, variousmanipulation devices for controlling the operation of the imaging device106. For example, in FIG. 3, a zoom switch 124, a focus switch 126, anoperation mode selecting switch 128, an imaging mode selecting switch130, and a display changing switch 132 are provided in the imagingdevice 106. Needless to say, the positions and forms where the zoomswitch 124, the focus switch 126, the operation mode selecting switch128, the imaging mode selecting switch 130, and the display changingswitch 132 are provided are not limited to the example illustrated inFIG. 3.

The zoom switch 124 and the focus switch 126 are examples ofmanipulation devices for adjusting imaging conditions in the imagingdevice 106.

The zoom switch 124 is formed of, for example, a zoom-in switch 124 athat increases the zoom magnification (the magnifying power), and azoom-out switch 124 b that decreases the zoom magnification. Bymanipulation of the zoom switch 124, the zoom magnification is adjustedand zooming is adjusted.

The focus switch 126 is formed of, for example, a distant view focusswitch 126 a that increases the focal distance to an observation target(a subject), and a near view focus switch 126 b that decreases the focaldistance to the observation target. By manipulation of the focus switch126, the focal distance is adjusted and focusing is adjusted.

The operation mode selecting switch 128 is an example of a manipulationdevice for selecting an operation mode of the arm 104 in the imagingdevice 106. By manipulation of the operation mode selecting switch 128,the operation mode of the arm 104 is changed. Examples of the operationmode of the arm 104 include, as described above, the fixed mode and thefree mode.

Examples of the manipulation of the operation mode selecting switch 128include manipulation where the operation mode selecting switch 128 ispressed down. For example, while a surgical operator is holding theoperation mode selecting switch 128 down, the operation mode of the arm104 is in the free mode, and when the surgical operator is not holdingthe operation mode selecting switch 128 down, the operation mode of thearm 104 is in the fixed mode.

The imaging mode selecting switch 130 is an example of a manipulationdevice for selecting an imaging mode of the imaging device 106.

Examples of the imaging mode of the imaging device 106 according to theembodiment include: an imaging mode where imaging is performed withspecial light (hereinafter, referred to as the “first imaging mode”);and one or more imaging modes that are different from the first imagingmode (hereinafter, referred to as the “second imaging mode/modes”).Examples of the second imaging mode according to the embodiment include:an imaging mode where imaging is performed with natural light; and animaging mode where imaging is performed by use of an image enhancementobservation technique, such as narrow band imaging (NBI).

Hereinafter, a captured medical image captured in the first imaging modemay be referred to as a “first captured medical image”.

Furthermore, hereinafter, one of captured medical images captured in thesecond imaging mode, the one having been captured in the second imagingmode before the first captured medical image may be referred to as a“second captured medical image”.

The captured medical image captured in the second imaging mode beforethe first captured medical image means a captured medical image capturedbefore a time point, at which the first captured medical image servingas a reference was captured. The first captured medical image serving asa reference may be, for example, a first captured medical image beingdisplayed on the display screen of the display device 300 (or a firstcaptured medical image that the control device 200 causes to bedisplayed on the display screen).

The second captured medical image according to the embodiment isspecified from captured medical images captured in the second imagingmode by, for example, the processing being performed, the processingbeing related to the later described display control method according tothe embodiment.

FIG. 4 is an explanatory diagram illustrating an example of the imagingmode selecting switch 130 that forms the imaging device 106 included inthe medical observation device 100 according to the embodiment. FIG. 4illustrates an example where the imaging mode selecting switch 130 is arotary switch. Needless to say, the imaging mode selecting switch 130 isnot necessarily a rotary switch.

When the imaging mode selecting switch 130 is in a state where “IR”illustrated in FIG. 4 has been selected, the imaging device 106 operatesin an imaging mode (an example of the first imaging mode) where imagingis performed with light of a near infra-red wavelength band. When theimaging mode selecting switch 130 is in the state where “IR” illustratedin FIG. 4 has been selected, a “filter that transmits therethrough lightof the near infra-red wavelength band and does not transmit therethroughlight of the other wavelength bands” is placed onto the optical path inthe imaging device 106.

When the imaging mode selecting switch 130 is in a state where “WLI”illustrated in FIG. 4 has been selected, the imaging device 106 operatesin an imaging mode (an example of the second imaging mode) where imagingis performed with natural light. When the imaging mode selecting switch130 is in the state where “WLI” illustrated in FIG. 4 has been selected,the “filter that transmits therethrough light of the near infra-redwavelength band and does not transmit therethrough light of the otherwavelength bands” is not placed on the optical path in the imagingdevice 106.

A surgical operator who uses the medical observation device 100 (anexample of a user of the medical observation device 100) manipulates theimaging mode selecting switch 130 and selects “IR” illustrated in FIG. 4or “WLI” illustrated in FIG. 4, and is thereby able to change theimaging mode.

Hereinafter, a case where the first imaging mode is an imaging modewhere imaging is performed with light of a near infra-red wavelengthband and the second imaging mode is an imaging mode where imaging isperformed with natural light will be described as an example.Furthermore, hereinafter, a state where the medical observation device100 performs imaging in an imaging mode where imaging is performed withspecial light, such as light of a near infra-red wavelength band, may bereferred to as “special light observation”, and a state where imaging isperformed with natural light may be referred to as “natural lightobservation”.

The first imaging mode according to the embodiment is not necessarilythe imaging mode where imaging is performed with light of a nearinfra-red wavelength band as described above, and may be a fluorescentwavelength band of fluorescent observation by use of 5-ALA. Furthermore,the medical observation device 100 may enable switch-over among pluralfirst imaging modes.

Furthermore, the second imaging mode according to the embodiment is notnecessarily the imaging mode where imaging is performed with naturallight as described above, and may be an imaging mode where imaging isperformed by use of a specific technique, such as NBI. Moreover, asdescribed above, the number of the second imaging modes according to theembodiment is not necessarily one, and may be two or more.

The example of the configuration of the imaging device 106 will bedescribed by reference to FIG. 3 again. The display changing switch 132is an example of a manipulation device for changing display on thedisplay screen in the imaging device 106. FIG. 3 illustrates an examplewhere the display changing switch 132 is a button switch. Needless tosay, the display changing switch 132 is not necessarily a button switch.

For example, when the display changing switch 132 is in an on-state,plural images are simultaneously displayed on the display screen of thedisplay device 300. The plural images simultaneously displayed on thedisplay screen of the display device 300 may include, for example, thefirst captured medical image and the second captured medical image. Acase where two images are simultaneously displayed on the display screenof the display device 300 when the display changing switch 132 is in theon-state will be described below as an example.

Furthermore, when the display changing switch 132 is in an off-state, asingle image is displayed on the display screen of the display device300. The single image displayed on the display screen of the displaydevice 300 may be, for example, a captured medical image correspondingto a state of the imaging mode selecting switch 130, that is, a capturedmedical image (a first captured medical image) captured in the firstimaging mode or a captured medical image captured in the second imagingmode.

The display changing switch 132 may be referred to as the “simultaneousdisplay button” below.

FIG. 3 illustrates an example where one display changing switch 132 isprovided in the imaging device 106, but any number of display changingswitches 132 corresponding to display changing patterns that are set maybe provided in the imaging device 106.

An image signal generated by imaging in the imaging device 106 istransmitted to, for example, the control device 200, and in the controldevice 200, various types of image processing are performed on the imagesignal.

The medical observation device 100 has, for example, the configurationdescribed above by reference to FIG. 1, FIG. 3, and FIG. 4.

The configuration of the medical observation device according to theembodiment is not limited to the configuration described by reference toFIG. 1, FIG. 3, and FIG. 4.

For example, FIG. 1 illustrates an example where the arm 104 isconfigured to realize six degrees of freedom with respect to driving ofthe imaging device 106, but the configuration of the arm 104 is notlimited to the configuration where the number of degrees of freedomrelated to the driving of the imaging device 106 is six. For example,the arm 104 may just be configured to be able to move the imaging device106 as appropriate according to a use, and the number and arrangement ofthe joints and links, and the directions of the drive axes of the jointsare able to be set as appropriate such that the arm 104 has desiredfreedom.

Furthermore, FIG. 3 illustrate an example where the various manipulationdevices for controlling the operation of the imaging device 106 areprovided in the imaging device 106, but a part or all of themanipulation devices illustrated in FIG. 3 may be not provided in theimaging device 106. For example, the various manipulation devices forcontrolling the operation of the imaging device 106 may be provided inanother part forming the medical observation device according to theembodiment, the part being other than the imaging device 106. Moreover,in another example, the various manipulation devices for controlling theoperation of the imaging device 106 may include an external manipulationdevice, such as a remote controller or a foot switch.

Furthermore, as described above, the medical observation deviceaccording to the embodiment may have functions of the control device200. If the medical observation device according to the embodiment hasfunctions of the control device 200, the medical observation deviceincludes a processor, such as an MPU, and various types of processingfor realizing the functions of the control device 200 are performed inthe processor.

Furthermore, as described above, the medical observation deviceaccording to the embodiment may have functions of the storage device400. If the medical observation device according to the embodiment hasfunctions of the storage device 400, the medical observation deviceincludes any recording medium, such as a non-volatile memory, which isable to store therein data.

Display Control Method According to Embodiment

The display control method according to the embodiment will be describednext, the display control method being applied to the medicalobservation system according to the embodiment.

A case where the display control method according to the embodiment isapplied to the medical observation system 1000 illustrated in FIG. 1 andthe processing related to the display control method according to theembodiment is executed by the control device 200 will be described belowas an example. That is, a case where the control device 200 functions asa medical display control device in the medical observation system 1000illustrated in FIG. 1 will be described below as an example.

If, for example, the medical observation device according to theembodiment has the functions of the control device 200, the processingrelated to the display control method according to the embodiment isexecuted by the medical observation device according to the embodiment.That is, in the medical observation system according to the embodiment,the medical observation device according to the embodiment may functionas a medical display control device.

[I] Example of Operation of Medical Observation System 1000

An example of operation of the medical observation system 1000 will bedescribed, before explanation of the processing related to the displaycontrol method according to the embodiment.

FIG. 5 is a block diagram illustrating an example of a configuration ofthe medical observation system 1000 according to the embodiment, towhich the display control method according to the embodiment is applied.FIG. 5 illustrates a part of a configuration of each device forming themedical observation system 1000 described by reference to FIG. 1, thepart being related to the display control method according to theembodiment.

An image signal generated by imaging in the imaging device 106 includedin the medical observation device 100 is transmitted to the controldevice 200.

In the control device 200, a display control unit 202 processes thereceived image signal. Furthermore, the display control unit 202 causesan image to be displayed on the display screen of the display device300, and stores image data into the storage device 400. In the controldevice 200, as described above, for example, the processor (notillustrated in the drawings) functions as the display control unit 202.

The display control unit 202 transmits, for example, a display controlsignal, and an image signal that has been subjected to predeterminedimage processing as appropriate, to the display device 300. For example,the display control unit 202 transmits, based on a result of theprocessing related to the later described display control methodaccording to the embodiment, “a display control signal including adisplay command that causes plural images to be simultaneously displayedon the display screen, and image signals corresponding to the pluralimages”, or “a display control signal including a display command thatcauses a single image to be displayed on the display screen, and animage signal corresponding to the single image”, to the display device300.

The display device 300 that has received the display control signal andthe image signal/signals displays, for example, an image or imagesrepresented by the image signal/signals on the display screen, accordingto the display control signal.

Furthermore, the display control unit 202 transmits a recording controlsignal including a recording command, and image data representing animage that has been subjected to predetermined image processing asappropriate, to the storage device 400. The storage device 400 that hasreceived the recording control signal and image data stores the imagedata, according to the recording control signal.

The display control unit 202 changes the format of the image to bestored in the storage device 400, for example, according to the imagingmode in the imaging device 106 included in the medical observationdevice 100.

For example, if the imaging device 106 included in the medicalobservation device 100 is operating in the imaging mode where imaging isperformed with natural light (an example of the second imaging mode),the display control unit 202 stores, as still images, images representedby image signals that have been received, into the storage device 400,at predetermined time intervals.

The predetermined time interval may be, for example, a fixed timeinterval, such as one second, or a variable time interval that isvariable based on manipulation by a person, such as a medical worker,who uses the medical observation system 1000.

If still images corresponding to the second imaging mode are stored inthe storage device 400 at predetermined time intervals, the displaycontrol unit 202 may compare the number of sets of image datarepresenting still images stored in the storage device 400 with apredetermined threshold that has been set, and cause overwriting andupdating according to a result of the comparison, in order from a stillimage that has been stored in the storage device 400 for a longer timeperiod (that is, an old still image). If, for example, the number ofsets of image data representing the still images exceeds thepredetermined threshold (or the number of sets of image datarepresenting the still images becomes equal to or greater than thepredetermined threshold), the display control unit 202 causes theoverwriting and updating. The predetermined threshold may be a fixedvalue, or may be a variable value that is variable based on manipulationby a person who uses the medical observation system 1000.

For example, by overwriting and updating of still images stored in thestorage device 400 as described above, the total data size of capturedmedical images captured in the second imaging mode and stored in thestorage device 400 is able to be limited.

Furthermore, in another example, if the imaging device 106 included inthe medical observation device 100 is operating in the imaging modewhere imaging is performed with light of a near infra-red wavelengthband (an example of the first imaging mode), the display control unit202 stores, as a moving image, an image represented by an image signalthat have been received, into the storage device 400. The displaycontrol unit 202 stores, as a single moving image, for example, “afterthe imaging mode is switched to the imaging mode where imaging isperformed with light of the near infra-red wavelength band from theother imaging mode, until the imaging mode where imaging is performedwith light of the near infra-red wavelength band is changed to the otherimaging mode”, into the storage device 400. A moving image correspondingto the first imaging mode as described above is used, for example, as amoving image for automatic play-back.

Needless to say, the display control unit 202 is able to store images ofthe same format into the storage device 400 regardless of the imagingmode in the imaging device 106 included in the medical observationdevice 100.

In the medical observation system 1000, by the operation of each deviceas described above, for example, a captured medical image captured inthe medical observation device 100 is displayed on the display screen ofthe display device 300, and image data representing the captured medicalimage are stored in the storage device 400.

[II] Example of Processing Related to Display Control Method Accordingto Embodiment

The processing related to the display control method according to theembodiment will be described next. In the following description, it willbe assumed that the processing related to the display control methodaccording to the embodiment is performed by the control device 200. Asdescribed above, in the control device 200, the processing related tothe display control method according to the embodiment is performed by,for example, the processor (not illustrated in the drawings) serving asthe display control unit 202.

The control device 200 controls display of captured medical images.

For example, the control device 200 causes a first captured medicalimage and a second captured medical image to be displayedsimultaneously. The second captured medical image to be displayed on thedisplay screen simultaneously with the first captured medical image maybe, for example, a still image. The second captured medical image to besimultaneously displayed with the first captured medical image may be amoving image.

The first captured medical image and the second captured medical imageare captured medical images that have been captured in different imagingmodes in a single imaging device, such as the imaging device 106included in the medical observation device 100. Therefore, by thecontrol device 200 performing the processing related to the displaycontrol method according to the embodiment, in the medical observationsystem 1000, simultaneous display of captured medical images on adisplay screen is realized, the captured medical images having beencaptured in an imaging device in different imaging modes.

Furthermore, since the second captured medical image is an imagecaptured before the first captured medical image, the imaging devicedoes not need to have a configuration for acquiring captured imagescaptured simultaneously in plural imaging modes. Therefore, when thedisplay control method according to the embodiment is used, the imagingdevice does not need to have a configuration including two CCDs like asurgical microscope that uses the technique described in PatentLiterature 1, and thus increase in cost of the imaging device is able tobe prevented and downsizing of the imaging device is facilitated.

As described with respect to a later described example of operation ofthe medical observation system, the control device 200 is also able todisplay, for example, one of the first captured medical image and thesecond captured medical image.

More specifically, the control device 200 controls display of capturedmedical images by performing a part or all of, for example: controlrelated to a first example described in Section (1) below to controlrelated a fourth example described in Section (4) below. The controldescribed in Sections (1) to (4) below is realized by, for example, thecontrol device 200 transmitting a display control signal and an imagesignal to a device for display of an image, such as the display device300, as described above.

(1) First Example of Control Related to Display Control Method: ControlRelated to How Captured Medical Images are Displayed

Control related to how captured medical images are displayed will bedescribed as a first example of control according to the display controlmethod.

The control device 200 causes, for example, a first captured medicalimage and a second captured medical image to be displayed in differentdisplay areas of the display screen.

For example, the control device 200 causes the display such that thedisplay area where the first captured medical image is displayed becomeslarger than the display area where the second captured medical image isdisplayed. The control device 200 causes, for example, the firstcaptured medical image to be displayed on the whole display screen, andthe second captured medical image to be displayed on a part of thedisplay screen. The control device 200 realizes “display of the firstcaptured medical image on the whole display screen, and display of thesecond captured medical image on a part of the display screen” by thePicture-in-Picture (PIP) technique.

Furthermore, for example, the control device 200 may divide the displayscreen into plural areas, and cause the first captured medical image andthe second captured medical image to be displayed respectively in theseplural areas. The size of the display area where the first capturedmedical image is displayed may be the same as, or different from, thesize of the display area where the second captured medical image isdisplayed.

How the captured medical images according to the embodiment aredisplayed is not limited to the above describe examples.

For example, the control device 200 may display the first capturedmedical image and the second captured medical image superimposed on thesame display area of the display screen. If the first captured medicalimage and the second captured medical image are displayed superimposedon each other, for example, the control device 200 detects the sameobject from each of the first captured medical image and the secondcaptured medical image, and alpha-blends the first captured medicalimage and second captured medical image such that positions of thedetected object overlap each other.

Furthermore, if the medical observation system according to theembodiment has plural display devices, for example, the control device200 may simultaneously display the first captured medical image andsecond captured medical image respectively on display screens of thesedifferent display devices. By transmitting, in synchronization, displaycontrol signals and image signals respectively to the display devicecaused to display thereon the first captured medical image and thedisplay device caused to display thereon the second captured medicalimage, the display control signals and image signals correspondingrespectively to these display devices, the first captured medical imageand the second captured medical image are simultaneously displayed onthe display screen of the different display devices respectively.

Furthermore, how the captured medical images according to the embodimentare displayed may be changeable. For example, the control device 200changes how the captured medical images are displayed, based onmanipulation of a manipulation device included in the control device 200or a manipulation device external to the control device 200.

(2) Second Example of Control Related to Display Control Method: ControlRelated to Specification of Second Captured Medical Image

Control related to specification of a second captured medical image willbe described as a second example of the control related to the displaycontrol method.

As described above, the second captured medical image according to theembodiment is “a captured medical image captured in the second imagingmode before a first captured medical image”. For example, the controldevice 200 extracts, from image data stored in the storage device 400,captured medical images captured in the second imaging mode, based on: afirst captured medical image being displayed on the display screen (anexample of a first captured medical image serving as a reference); or afirst captured medical image to be displayed on the display screen(another example of the first captured medical image serving as thereference), the extracted captured medical images serving as candidatesfor the second captured medical image. The control device 200 determinesa time point, at which the first captured medical image serving as thereference was captured, by, for example, referring to meta data of imagedata representing the first captured medical image serving as thereference. The control device 200 then specifies the second capturedmedical image from the extracted captured medical images serving ascandidates for the second captured medical image.

If the number of captured medical images serving as candidates is one,the control device 200 specifies this captured medical image serving asa candidate as the second captured medical image.

Furthermore, if there are plural captured medical images serving ascandidates, for example, the control device 200 specifies a capturedmedical image to be displayed simultaneously with the first capturedmedical image, from the plural captured medical images serving ascandidates, as described, for example, in Sections (a) to (c) below. Thecontrol device 200 then causes the specified captured medical image tobe displayed as the second captured medical image, simultaneously withthe first captured medical image, on the display screen.

(a) First Method of Determining Second Captured Medical Image

The control device 200 specifies, as the second captured medical image,for example, a captured medical image captured in the second imagingmode within a predetermined time period from the time point, at whichthe first captured medical image serving as the reference was captured.

The predetermined time period may be a preset fixed time period (forexample, 20 seconds, or one minute), or may be a variable time periodthat is variable based on manipulation by a person, such as a medicalworker, who uses the medical observation system 1000. If thepredetermined time period is a fixed time period, the predetermined timeperiod is set at the time of designing or at the time of manufacturing,in consideration of, for example, imaging mode switching performance inthe medical observation device 100 (this performance being determinedbased on, for example, a time period, in which a change of the imagingmode is completed in the medical observation device 100). Furthermore,if the predetermined time period is a variable time period, thepredetermined time period is set by manipulation of, for example, amanipulation device included in the control device 200 or a manipulationdevice, such as a remote controller, which is external to the controldevice 200, by a user, such as a surgical operator or a nurse, who usesthe control device 200 (an example of a device that functions as amedical display control device in the medical observation system 1000).

If there are plural captured medical images captured in the secondimaging mode in the predetermined time period, for example, the controldevice 200 specifies, as the second captured medical image, a capturedmedical image randomly selected from the plural captured medical images.Furthermore, if there are plural captured medical images captured in thesecond imaging mode in the predetermined time period, for example, thecontrol device 200 specifies the second captured medical image bycombining another determination method, such as a later describeddetermination method according to a second example.

(b) Second Method of Determining Second Captured Medical Image

The control device 200 specifies, as the second captured medical image,for example, an image that has been evaluated most highly, from capturedmedical images captured in the second imaging mode before the firstcaptured medical image serving as a reference.

For example, the control device 200 estimates the amount of noise ineach of the captured medical images serving as candidates, by using anymethod that enables estimation of noise from an image, such as Bayesianestimation where a noise quantity model is used. The control device 200then specifies, as the second captured medical image, the capturedmedical image serving as the candidate with the least amount of noise.

The method of evaluating an image according to the embodiment is notlimited to the above described example. For example, the control device200 is able to perform any processing enabling quantitative evaluationof an image, and specify, as the second captured medical image, acaptured medical image having the highest evaluation value.

Furthermore, as described in Section (a) above, by combination betweenthe second determination method and the first determination methoddescribed in Section (a) above, the control device 200 is able tospecify the second captured medical image.

(c) Third Method of Determining Second Captured Medical Image

The control device 200 specifies, as the second captured medical image,an image that has been selected based on a selecting manipulation forselecting an image, from captured medical images captured in the secondimaging mode before the first captured medical image.

The control device 200 specifies the image selected based on theselecting manipulation, based on, for example, a signal corresponding tothe selecting manipulation, the signal being acquired from amanipulation device included in the control device 200 or a manipulationdevice external to the control device 200. The control device 200 thenspecifies the specified image, as the second captured medical image.

If a third determination method is used, the control device 200 causes,for example, a UI to be automatically displayed on the display screen ofthe display device 300 or the like, the UI being for display of a listof captured medical images serving as candidates. Furthermore, when thethird determination method is used, the control device 200 may cause,for example, a UI to be displayed based on a signal corresponding to apredetermined manipulation acquired from a manipulation device includedin the control device 200, the UI being for display of a list ofcaptured medical images serving as candidates.

If there are plural captured medical images serving as candidates, forexample, the control device 200 specifies the second captured medicalimage as described in

Sections (a) to (c) above. Needless to say, methods of determining thesecond captured medical image are not limited to the examples describedin Sections (a) to (c) above.

(3) Third Example of Control Related to Display Control Method: ControlRelated to Start and End of Display for Simultaneous Display of FirstCaptured Medical Image and Second Captured Medical Image

Described as a third example of the control related to the displaycontrol method is control related to start and end of display forsimultaneous display of a first captured medical image and a secondcaptured medical image. Hereinafter, simultaneous display of a firstcaptured medical image and a second captured medical image may bereferred to as “simultaneous display”.

The control device 200 performs, for example, the control described inSection (3-1) below or the control described in Section (3-2) below, asthe control related to start and end of simultaneous display.

(3-1) First Example of Control Related to Start and End of SimultaneousDisplay

When an imaging device to be controlled, such as the imaging device 106included in the medical observation device 100, is determined to be inthe first imaging mode, the control device 200 causes a first capturedmedical image and a second captured medical image to be simultaneouslydisplayed.

When a first mode switching manipulation for switching the secondimaging mode to the first imaging mode is detected, the control device200 determines that the imaging device is in the first imaging mode.

In an example where the imaging device to be controlled is the imagingdevice 106 included in the medical observation device 100, the controldevice 200 determines that the first mode switching manipulation hasbeen detected, if, for example, a switching signal corresponding to thefirst imaging mode (an example of a switching signal according tomanipulation of the imaging mode selecting switch 130) has been acquiredfrom the medical observation device 100.

The method of detecting the first mode switching manipulation in thecontrol device 200 is not limited to the above described example. Forexample, if the imaging mode in the imaging device 106 included in themedical observation device 100 is switched over by an externalmanipulation device, such as a remote controller, the control device 200is able to detect the first mode switching manipulation, based on asignal acquired from the external manipulation device.

Furthermore, if the imaging device to be controlled is determined to bein the second imaging mode after the imaging device is determined to bein the first imaging mode, the control device 200 causes a capturedmedical image to be displayed, the captured medical image having beencaptured in the imaging device in the second imaging mode. This capturedmedical image captured in the second imaging mode is different from thesecond captured medical image, and is a captured medical image notdependent on the time point, at which the first captured medical imagewas captured.

If a second mode switching manipulation for switching the first imagingmode to the second imaging mode has been detected, the control device200 determines that the imaging device is in the second imaging mode.

In an example where the imaging device to be controlled is the imagingdevice 106 included in the medical observation device 100, the controldevice 200 determines that the second mode switching manipulation hasbeen detected, if, for example, a switching signal corresponding to thesecond imaging mode (another example of the switching signal accordingto the manipulation of the imaging mode selecting switch 130) has beenacquired from the medical observation device 100.

The method of detecting the second mode switching manipulation in thecontrol device 200 is not limited to the above described example. Forexample, if the imaging mode in the imaging device 106 included in themedical observation device 100 is switched over by an externalmanipulation device, the control device 200 is able to detect the secondmode switching manipulation, based on a signal acquired from theexternal manipulation device.

(3-2) Second Example of Control Related to Start and End of SimultaneousDisplay

The control device 200 causes the first captured medical image and thesecond captured medical image to be simultaneously displayed, if adisplay changing manipulation for changing display is detected when thefirst captured medical image is being displayed.

In an example where an imaging device to be controlled is the imagingdevice 106 included in the medical observation device 100, the controldevice 200 determines that the display changing manipulation has beendetected, if, for example, a signal indicating that the state of thedisplay changing switch 132 has changed is acquired from the medicalobservation device 100.

The method of detecting the display changing manipulation in the controldevice 200 is not limited to the above described example. For example,if the change of display is performed by manipulation of an externalmanipulation device, such as a remote controller, the control device 200is able to detect the display changing manipulation based on a signalacquired from the external manipulation device.

Furthermore, the control device 200 causes only a first captured medicalimage to be displayed if a display changing manipulation is detectedfurther after the first captured medical image and a second capturedmedical image are simultaneously displayed based on a display changingmanipulation.

(4) Fourth Example of Control Related to Display Control Method: ControlRelated to Change of Second Captured Medical Image

Control related to change of a second captured medical image will bedescribed as a fourth example of the control related to the displaycontrol method.

If a selecting manipulation for selecting an image is detected when afirst captured medical image and a second captured medical image arebeing simultaneously displayed, the control device 200 changes thesecond captured medical image being displayed on the display screen to asecond captured medical image corresponding to the selectingmanipulation.

The control device 200 specifies an image selected based on theselecting manipulation, based on, for example, a signal corresponding tothe selecting manipulation, the signal being acquired from amanipulation device included in the control device 200 or a manipulationdevice external to the control device 200. The image specified asdescribed above corresponds to the second captured medical imagecorresponding to the selecting manipulation. The control device 200 thenreplaces the second captured medical image being displayed on thedisplay screen, with the specified image.

When the control related to the fourth example is performed, the controldevice 200 may cause, for example, a UI to be displayed based on asignal corresponding to a predetermined manipulation acquired from amanipulation device or the like included in the control device 200, theUI being for display of a list of second captured medical images servingas replacement candidates for the second captured medical image beingdisplayed.

When the control related to the fourth example is performed, a medicalworker, such as a surgical operator, is able to replace a secondcaptured medical image displayed simultaneously with a first capturedmedical image, with a desired second captured medical image, and thusconvenience for the medical worker is able to be improved.

(5) Another Example of Control Related to Display Control Method

Examples of the control related to the display control method accordingto the embodiment are not limited to the first example described inSection (1) above to the fourth example described in Section (4) above.

For example, the control device 200 may simultaneously display “acaptured medical image captured in the second imaging mode” and “acaptured medical image captured in the first imaging mode before thecaptured medical image captured in the second imaging mode”.

Furthermore, the control device 200 may display one or more otherimages, together with a captured medical image. Examples of the otherimages include: an image related to a patient who receives medicalintervention, such as an image depicting vitals of a patient whoreceives medical intervention; an image depicting a flow of a surgicaloperation (for example, an image indicating content of a surgicaloperation manual according to operative surgical procedures); and a UIimage.

[III] Example of Operation Realized by Processing Related to DisplayControl Method According to Embodiment

Described next is an example of operation of the medical observationsystem according to the embodiment, the operation being realized by theprocessing related to the display control method according to theembodiment.

FIG. 6 is an explanatory diagram for explanation of an example ofoperation of the medical observation system 1000 according to theembodiment, the operation being realized by the processing related tothe display control method according to the embodiment. In FIG. 6, “A”represents an example of state transition of the medical observationdevice 100, the state transition corresponding to manipulation ofvarious manipulation devices included in the medical observation device100. Furthermore, in FIG. 6, “B” represents an example of operation ofthe control device 200 and the storage device 400.

Furthermore, FIG. 7 to FIG. 10 are diagrams illustrating examples ofcaptured medical images displayed on the display screen of the displaydevice 300 by the operation of the medical observation system 1000illustrated in FIG. 6.

FIG. 7 illustrates an example where a captured medical image, which isacquired when the medical observation device 100 is involved in naturallight observation, is being displayed on the display screen.

FIG. 8 illustrates an example where a first captured medical image,which is acquired when the medical observation device 100 is involved inspecial light observation, is being displayed on the display screen.FIG.

8 illustrates, as the first captured medical image, an example of acaptured image resulting from imaging with light of a near infra-redwavelength band.

FIG. 9 illustrates “an example where a first captured medical image anda second captured medical image are being simultaneously displayed onthe display screen. FIG. 9 illustrates, as the first captured medicalimage, an example of a captured image resulting from imaging with lightof a near infra-red wavelength band, similarly to FIG. 8. Furthermore,FIG. 9 illustrates, as the second captured medical image, an example ofa captured medical image acquired when the medical observation device100 is involved in natural light observation, similarly to FIG. 7.

FIG. 10 illustrates an example where “a captured medical image capturedin the second imaging mode” and “a captured medical image captured inthe first imaging mode before the captured medical image captured in thesecond imaging mode” are being simultaneously displayed on the displayscreen. FIG. 10 illustrates, as the second captured medical image, anexample of a captured medical image acquired when the medicalobservation device 100 is involved in natural light observation,similarly to FIG. 7. Furthermore, FIG. 10 illustrates, as the firstcaptured medical image, an example of a captured image resulting fromimaging with light of a near infra-red wavelength band, similarly toFIG. 8.

An example of the operation of the medical observation system 1000, theoperation being realized by the processing related to the displaycontrol method according to the embodiment, will be described below byreference, as appropriate, to FIG. 6 to FIG. 10.

(i) (a) In FIG. 6 As the power source of the storage device 400 isturned into an on-state when the medical observation device 100 isinvolved in natural light observation, a still image (an example of thesecond captured medical image) of the natural light observation isrecorded every second (an example of the predetermined time interval).Furthermore, a captured medical image, which is, for example,illustrated in FIG. 7 and acquired when natural light observation isperformed, is displayed on the display screen of the display device 300.

(ii) (b) In FIG. 6

For example, when a surgical operator manipulates the imaging modeselecting switch 130 of the medical observation device 100, such thatthe imaging mode selecting switch 130 is brought into a state where “IR”illustrated in FIG. 4 has been selected, a moving image of special lightobservation (an example of the first captured medical image) is recordedinto the storage device 400. Furthermore, the first captured medicalimage illustrated in FIG. 8, for example, is displayed on the displayscreen of the display device 300.

(iii) (c) In FIG. 6

If a surgical operator performs manipulation for bringing the displaychanging switch 132 of the medical observation device 100 into theon-state when the medical observation device 100 is involved in speciallight observation, for example, the first captured medical image and thesecond captured medical image are simultaneously displayed on thedisplay screen of the display device 300, for example, as illustrated inFIG. 9.

The first captured medical image displayed is a first captured medicalimage that is a result of the current imaging in the first imaging mode.Furthermore, the second captured medical image simultaneously displayedwith the first captured medical image is a captured medical imagecaptured in the second imaging mode before the first captured medicalimage. The second captured medical image displayed simultaneously withthe first captured medical image may be, for example, the still imagerecorded in the storage device 400 at (a) in FIG. 6. The second capturedmedical image simultaneously displayed with the first captured medicalimage may be changeable by manipulation of any manipulation device, suchas a remote controller.

(iv) (d) In FIG. 6

When a surgical operator performs manipulation for turning the displaychanging switch 132 of the medical observation device 100 into theoff-state further, for example, the first captured medical image, whichis a captured medical image corresponding to the current imaging mode ofthe medical observation device 100, is displayed on the display screenof the display device 300.

(v) (e) In FIG. 6

For example, when a surgical operator manipulates the imaging modeselecting switch 130 of the medical observation device 100, such thatthe imaging mode selecting switch 130 is brought into a state where“WLI” illustrated in FIG. 4 has been selected, the medical observationdevice 100 is switched over from special light observation to naturallight observation. When the imaging mode is changed in the medicalobservation device 100; in the storage device 400, recording of themoving image of special light observation (an example of the firstcaptured medical image) is stopped and a still image of natural lightobservation (an example of the second captured medical image) isrecorded every second (an example of the predetermined time interval).

(vi) (f) In FIG. 6

When a surgical operator performs manipulation for turning the displaychanging switch 132 of the medical observation device 100 into theon-state when the medical observation device 100 is involved in speciallight observation, for example, a “captured medical image captured inthe second imaging mode” and a “captured medical image captured in thefirst imaging mode before the captured medical image captured in thesecond imaging mode” are simultaneously displayed on the display screenof the display device 300, for example, as illustrated in FIG. 10.

The “captured medical image captured in the second imaging mode”displayed is a captured medical image that is a result of the currentimaging in the second imaging mode. Furthermore, the “captured medicalimage captured in the first imaging mode before the captured medicalimage captured in the second imaging mode” may be, for example, themoving image recorded in the storage device 400 at (b) in FIG. 6. Forexample, if a moving image, such as the moving image recorded in thestorage device 400 at (b) in FIG. 6, is displayed on the display screen,for example, the moving image is repeatedly played back. The “capturedmedical image captured in the first imaging mode before the capturedmedical image captured in the second imaging mode” may be changeable bymanipulation of any manipulation device, such as a remote controller.

(vii) (g) In FIG. 6

When a surgical operator performs manipulation for turning the displaychanging switch 132 of the medical observation device 100 into theoff-state further, for example, a captured medical image, which is acaptured medical image corresponding to the current imaging mode of themedical observation device 100 and which is acquired when natural lightobservation is performed, is displayed on the display screen of thedisplay device 300.

(viii) (h) In FIG. 6

When the power source of the storage device 400 is turned into theoff-state, recording of the still image (an example of the secondcaptured medical image) of natural light observation is stopped.

The operation of the medical observation system 1000 described byreference to FIG. 6 is realized, for example, by the processing beingperformed in the control device 200, the processing being related to thedisplay control method according to the embodiment.

Examples of the operation of the medical observation system 1000realized by the processing related to the display control methodaccording to the embodiment are not limited to the example described byreference to FIG. 6. For example, the example described by reference toFIG. 6 is an example where two captured medical images aresimultaneously displayed on the display screen, but three or morecaptured medical images may be simultaneously displayed on the displayscreen. Furthermore, as described above, one or more other images may bedisplayed together with a captured medical image.

[IV] Example of Effects Achieved by Use of Display Control MethodAccording to Embodiment

Use of the display control method according to the embodiment achieves,for example, the following effects in the medical observation systemaccording to the embodiment. Needless to say, effects achieved by use ofthe display control method according to the embodiment are not limitedto the following examples.

Since a captured medical image (a still image or a moving image)acquired in the immediately preceding imaging mode is displayedsimultaneously with a captured medical image acquired in the currentimaging mode, the imaging device does not need to have a configurationincluding two CCDs like a surgical microscope where the techniquedescribed in Patent Literature 1 is used. Therefore, the cost of theimaging device is able to be prevented from increasing, and downsizingof the imaging device is facilitated.

When time-series imaging is performed in an imaging device, the framerate may be decreased, but in the medical observation system accordingto the embodiment, since captured medical images are recorded perimaging mode, the frame rate is not decreased.

Simultaneous display of a captured medical image of special lightobservation (the first captured medical image) and a captured medicalimage of natural light observation (an example of the second capturedmedical image) on the display screen enables facilitation of observationof a part that is difficult to be identified when only the capturedmedical image of special light observation is displayed.

As illustrated in FIG. 9, for example, by display of a captured medicalimage of special light observation (the first captured medical image)and a captured medical image of natural light observation (an example ofthe second captured medical image) in different display areas of thedisplay screen, a medical worker, such as a surgical operator, is ableto distinguish a fine blood vessel more easily.

Program According to Embodiment

By a program (for example, a program that is able to execute theprocessing related to the display control method according to theembodiment) being executed by a processor or the like in a computersystem, the program being for causing the computer system to function asthe medical display control device according to the embodiment, capturedmedical images captured in different imaging modes in a single imagingdevice are able to be simultaneously displayed on a display screen. Thecomputer system according to the embodiment may be a single computer, orplural computers. The sequential processing related to the displaycontrol method according to the embodiment is executed by the computersystem according to the embodiment.

Furthermore, the above described effects achieved by the displayrealized by the processing related to the display control methodaccording to the embodiment are able to be achieved by execution of theprogram by the processor or the like in the computer system, the programbeing for causing the computer system to function as the medical displaycontrol device according to the embodiment.

Preferred embodiments of the present disclosure have been described thusfar in detail by reference to the appended drawings, but the technicalscope of the present disclosure is not limited to these examples. It isevident that any person having ordinary knowledge in the technical fieldof the present disclosure is able to devise various modified examplesand reformed examples within the scope of technical ideas described inthe claims, and these examples will of course be understood as belongingto the technical scope of the present disclosure.

For example, according to the above description, the program (a computerprogram) for causing the computer system to function as the medicaldisplay control device according to the embodiment is provided, butaccording to the embodiment, a recording medium having, stored therein,the program may also be provided further.

The above described configurations are examples of the embodiment, andof course belong to the technical scope of the present disclosure.

Furthermore, the effects described in this specification are justexplanatory or exemplary, and are not limiting. That is, the techniquesaccording to the present disclosure may achieve, together with the abovedescribed effects, or instead of the above described effects, any othereffect evident to those skilled in the art from the description in thisspecification.

The following configurations also belong to the technical scope of thepresent disclosure.

(1)

A medical display control device, comprising:

a display control unit that causes a first captured medical image and asecond captured medical image to be simultaneously displayed, the firstcaptured medical image having been captured in an imaging device in afirst imaging mode where imaging is performed with special light, thesecond captured medical image having been captured in the imaging devicein a second imaging mode different from the first imaging mode beforethe first captured medical image.

(2)

The medical display control device according to (1), wherein the displaycontrol unit causes the first captured medical image and the secondcaptured medical image to be displayed in different display areas of adisplay screen.

(3)

The medical display control device according to (2), wherein the displaycontrol unit causes the display such that the display area where thefirst captured medical image is displayed is larger than the displayarea where the second captured medical image is displayed.

(4)

The medical display control device according to (3), wherein the displaycontrol unit causes the first captured medical image to be displayed onthe whole display screen, and the second captured medical image to bedisplayed on a part of the display screen.

(5)

The medical display control device according to (1), wherein the displaycontrol unit causes the first captured medical image and the secondcaptured medical image to be displayed superimposed on the same displayarea of a display screen.

(6)

The medical display control device according to (1), wherein the displaycontrol unit causes the first captured medical image and the secondcaptured medical image to be displayed respectively on display screensof different display devices.

(7)

The medical display control device according to any one of (1) to (6),wherein the display control unit causes the first captured medical imageand the second captured medical image to be simultaneously displayedwhen the imaging device is determined to be in the first imaging mode.

(8)

The medical display control device according to (7), wherein the displaycontrol unit determines that the imaging device is in the first imagingmode when a first mode switching manipulation for switching the secondimaging mode to the first imaging mode is detected.

(9)

The medical display control device according to (7) or (8), wherein thedisplay control unit causes a captured medical image to be displayed,the captured medical image having been captured in the imaging device inthe second imaging mode, when the imaging device is determined to be inthe second imaging mode after the imaging device is determined to be inthe first imaging mode.

(10)

The medical display control device according to (9), wherein the displaycontrol unit determines that the imaging device is in the second imagingmode when a second mode switching manipulation for switching the firstimaging mode to the second imaging mode is detected.

(11)

The medical display control device according to any one of (1) to (6),wherein the display control unit causes the first captured medical imageand the second captured medical image to be simultaneously displayedwhen a display changing manipulation for changing display is detectedwhen the first captured medical image is being displayed.

(12)

The medical display control device according to (11), wherein thedisplay control unit causes only the first captured medical image to bedisplayed when the display changing manipulation is detected furtherafter the first captured medical image and the second captured medicalimage are simultaneously displayed based on the display changingmanipulation.

(13)

The medical display control device according to any one of (1) to (12),wherein if a selecting manipulation for selecting an image is detectedwhen the first captured medical image and the second captured medicalimage are being simultaneously displayed, the display control unitchanges the second captured medical image being displayed on a/thedisplay screen to the second captured medical image corresponding to theselecting manipulation.

(14)

The medical display control device according to any one of (1) to (13),wherein the second captured medical image is a captured medical imagecaptured in the second imaging mode within a predetermined time periodfrom a time point, at which the first captured medical image wascaptured.

(15)

The medical display control device according to (14), wherein thepredetermined time period is a fixed time period that has been setbeforehand, or a time period set based on manipulation by a user whouses the medical display control device.

(16)

The medical display control device according to any one of (1) to (15),wherein the second captured medical image is an image that has beenevaluated most highly, the image being from captured medical imagescaptured in the second imaging mode before the first captured medicalimage.

(17)

The medical display control device according to any one of (1) to (13),wherein the second captured medical image is an image selected based ona selecting manipulation for selecting the image, the image being fromcaptured medical images captured in the second imaging mode before thefirst captured medical image.

(18)

A medical observation device, comprising: an arm formed of plural linksconnected to one another via joints;

an imaging device supported by the arm; and

a display control unit that causes a first captured medical image and asecond captured medical image to be simultaneously displayed, the firstcaptured medical image having been captured in the imaging device in afirst imaging mode where imaging is performed with special light, thesecond captured medical image having been captured in the imaging devicein a second imaging mode different from the first imaging mode beforethe first captured medical image.

(19)

A display control method executed by a medical display control device,the display control method including:

a step of simultaneously displaying a first captured medical imagecaptured in an imaging device in a first imaging mode where imaging isperformed with special light, and a second captured medical imagecaptured in the imaging device in a second imaging mode different fromthe first imaging mode before the first captured medical image.

(20)

A medical observation system, comprising:

a medical observation device including: an arm formed of plural linksconnected to one another via joints; and an imaging device supported bythe arm;

a display device; and

a medical display control device including a display control unit thatcauses a first captured medical image and a second captured medicalimage to be simultaneously displayed on a display screen of the displaydevice, the first captured medical image having been captured in theimaging device in a first imaging mode where imaging is performed withspecial light, the second captured medical image having been captured inthe imaging device in a second imaging mode different from the firstimaging mode before the first captured medical image.

REFERENCE SIGNS LIST

100 MEDICAL OBSERVATION DEVICE

102 BASE

104 ARM

106 IMAGING DEVICE

110 a, 110 b, 110 c, 110 d, 110 e, 110 f JOINT

112 a, 112 b, 112 c, 112 d, 112 e, 112 f LINK

120 IMAGING MEMBER

122 CYLINDRICAL MEMBER

124 ZOOM SWITCH

126 FOCUS SWITCH

128 OPERATION MODE SELECTING SWITCH

130 IMAGING MODE SELECTING SWITCH

132 DISPLAY CHANGING SWITCH

200 CONTROL DEVICE

300 DISPLAY DEVICE

400 STORAGE DEVICE

1000 MEDICAL OBSERVATION SYSTEM

OP SURGICAL OPERATOR

PA PATIENT

FS FOOT SWITCH

1. A medical display control device, comprising: a display control unitconfigured to cause a first captured medical image and a second capturedmedical image to be simultaneously displayed, the first captured medicalimage having been captured in an imaging device in a first imaging modewhere imaging is performed with special light, the second capturedmedical image having been captured in the imaging device in a secondimaging mode different from the first imaging mode before the firstcaptured medical image.
 2. The medical display control device accordingto claim 1, wherein the display control unit is configured to cause thefirst captured medical image and the second captured medical image to bedisplayed in different display areas of a display screen.
 3. The medicaldisplay control device according to claim 2, wherein the display controlunit is configured to cause the display such that the display area wherethe first captured medical image is displayed is larger than the displayarea where the second captured medical image is displayed.
 4. Themedical display control device according to claim 3, wherein the displaycontrol unit is configured to cause the first captured medical image tobe displayed on the whole display screen, and the second capturedmedical image to be displayed on a part of the display screen.
 5. Themedical display control device according to claim 1, wherein the displaycontrol unit is configured to cause the first captured medical image andthe second captured medical image to be displayed superimposed on thesame display area of a display screen.
 6. The medical display controldevice according to claim 1, wherein the display control unit isconfigured to cause the first captured medical image and the secondcaptured medical image to be displayed respectively on display screensof different display devices.
 7. The medical display control deviceaccording to claim 1, wherein the display control unit is configured tocause the first captured medical image and the second captured medicalimage to be simultaneously displayed when the imaging device isdetermined to be in the first imaging mode.
 8. The medical displaycontrol device according to claim 7, wherein the display control unit isconfigured to determine that the imaging device is in the first imagingmode when a first mode switching manipulation for switching the secondimaging mode to the first imaging mode is detected.
 9. The medicaldisplay control device according to claim 7, wherein the display controlunit is configured to cause a captured medical image to be displayed,the captured medical image having been captured in the imaging device inthe second imaging mode, when the imaging device is determined to be inthe second imaging mode after the imaging device is determined to be inthe first imaging mode.
 10. The medical display control device accordingto claim 9, wherein the display control unit is configured to determinethat the imaging device is in the second imaging mode when a second modeswitching manipulation for switching the first imaging mode to thesecond imaging mode is detected.
 11. The medical display control deviceaccording to claim 1, wherein the display control unit is configured tocause the first captured medical image and the second captured medicalimage to be simultaneously displayed when a display changingmanipulation for changing display is detected when the first capturedmedical image is being displayed.
 12. The medical display control deviceaccording to claim 11, wherein the display control unit is configured tocause only the first captured medical image to be displayed when thedisplay changing manipulation is detected further after the firstcaptured medical image and the second captured medical image aresimultaneously displayed based on the display changing manipulation. 13.The medical display control device according to claim 1, wherein if aselecting manipulation for selecting an image is detected when the firstcaptured medical image and the second captured medical image are beingsimultaneously displayed, the display control unit changes the secondcaptured medical image being displayed on a display screen to the secondcaptured medical image corresponding to the selecting manipulation. 14.The medical display control device according to claim 1, wherein thesecond captured medical image is a captured medical image captured inthe second imaging mode within a predetermined time period from a timepoint, at which the first captured medical image was captured.
 15. Themedical display control device according to claim 14, wherein thepredetermined time period is a fixed time period that has been setbeforehand, or a time period set based on manipulation by a user whouses the medical display control device.
 16. The medical display controldevice according to claim 1, wherein the second captured medical imageis an image that has been evaluated most highly, the image being fromcaptured medical images captured in the second imaging mode before thefirst captured medical image.
 17. The medical display control deviceaccording to claim 1, wherein the second captured medical image is animage selected based on a selecting manipulation for selecting theimage, the image being from captured medical images captured in thesecond imaging mode before the first captured medical image.
 18. Amedical observation device, comprising: an arm formed of plural linksconnected to one another via joints; an imaging device supported by thearm; and a display control unit is configured to cause a first capturedmedical image and a second captured medical image to be simultaneouslydisplayed, the first captured medical image having been captured in theimaging device in a first imaging mode where imaging is performed withspecial light, the second captured medical image having been captured inthe imaging device in a second imaging mode different from the firstimaging mode before the first captured medical image.
 19. A displaycontrol method executed by a medical display control device, the displaycontrol method comprising: a step of simultaneously displaying a firstcaptured medical image captured in an imaging device in a first imagingmode where imaging is performed with special light, and a secondcaptured medical image captured in the imaging device in a secondimaging mode different from the first imaging mode before the firstcaptured medical image.
 20. A medical observation system, comprising: amedical observation device including: an arm formed of plural linksconnected to one another via joints; and an imaging device supported bythe arm; a display device; and a medical display control deviceincluding a display control unit is configured to cause a first capturedmedical image and a second captured medical image to be simultaneouslydisplayed on a display screen of the display device, the first capturedmedical image having been captured in the imaging device in a firstimaging mode where imaging is performed with special light, the secondcaptured medical image having been captured in the imaging device in asecond imaging mode different from the first imaging mode before thefirst captured medical image.